Skip to content

Comments

Adds model load endpoint to models API#113

Merged
doringeman merged 5 commits intomainfrom
model-load
Jul 24, 2025
Merged

Adds model load endpoint to models API#113
doringeman merged 5 commits intomainfrom
model-load

Conversation

@ekcasey
Copy link
Contributor

@ekcasey ekcasey commented Jul 18, 2025

Add POST /models/load endpoint to the model manager which allows TAR formatted models to by streamed from the client and stored in the archive. See docker/model-distribution#113 for formatting details.

Endpoint should be analagous to POST images/load in the docker engine API.

@ekcasey ekcasey force-pushed the model-load branch 2 times, most recently from fafd9e8 to 14de02e Compare July 24, 2025 02:59
@ekcasey ekcasey requested a review from xenoscopic July 24, 2025 02:59
@ekcasey ekcasey force-pushed the model-load branch 2 times, most recently from 0dfa50a to f667a10 Compare July 24, 2025 03:37
@ekcasey ekcasey marked this pull request as ready for review July 24, 2025 03:39
Signed-off-by: Emily Casey <emily.casey@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
doringeman and others added 3 commits July 24, 2025 14:39
Co-authored-by: Jacob Howard <jacob.howard@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
@doringeman doringeman merged commit 7777c22 into main Jul 24, 2025
4 checks passed
@doringeman doringeman deleted the model-load branch July 24, 2025 11:52
doringeman added a commit to doringeman/model-runner that referenced this pull request Sep 23, 2025
* Adds support for packaging/loading models to/from TAR archive

Signed-off-by: Emily Casey <emily.casey@docker.com>

* Check for blobs when writing manifest

Signed-off-by: Emily Casey <emily.casey@docker.com>

* LoadModel: don't crash on cancellation

Signed-off-by: Dorin Geman <dorin.geman@docker.com>

---------

Signed-off-by: Emily Casey <emily.casey@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
Co-authored-by: Dorin Geman <dorin.geman@docker.com>
doringeman added a commit to doringeman/model-runner that referenced this pull request Sep 23, 2025
* Adds support for packaging/loading models to/from TAR archive

Signed-off-by: Emily Casey <emily.casey@docker.com>

* Check for blobs when writing manifest

Signed-off-by: Emily Casey <emily.casey@docker.com>

* LoadModel: don't crash on cancellation

Signed-off-by: Dorin Geman <dorin.geman@docker.com>

---------

Signed-off-by: Emily Casey <emily.casey@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
Co-authored-by: Dorin Geman <dorin.geman@docker.com>
doringeman added a commit to doringeman/model-runner that referenced this pull request Sep 24, 2025
* Adds support for packaging/loading models to/from TAR archive

Signed-off-by: Emily Casey <emily.casey@docker.com>

* Check for blobs when writing manifest

Signed-off-by: Emily Casey <emily.casey@docker.com>

* LoadModel: don't crash on cancellation

Signed-off-by: Dorin Geman <dorin.geman@docker.com>

---------

Signed-off-by: Emily Casey <emily.casey@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
Co-authored-by: Dorin Geman <dorin.geman@docker.com>
doringeman added a commit to doringeman/model-runner that referenced this pull request Sep 24, 2025
* Adds support for packaging/loading models to/from TAR archive

Signed-off-by: Emily Casey <emily.casey@docker.com>

* Check for blobs when writing manifest

Signed-off-by: Emily Casey <emily.casey@docker.com>

* LoadModel: don't crash on cancellation

Signed-off-by: Dorin Geman <dorin.geman@docker.com>

---------

Signed-off-by: Emily Casey <emily.casey@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
Co-authored-by: Dorin Geman <dorin.geman@docker.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants